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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the application: 



Listing of Claims: 

1 1 . (Currently amended) A method of displaying multimedia information 

2 stored in a multimedia document on a display, the method comprising: 

3 displaying a graphical user interface (GUI) on the display; 

4 displaying, in a first area of the GUI, a first visual representation of the 

5 multimedia information stored in the multimedia document, the first visual representation 

6 including a first representation of information of a first type stored in the multimedia document 

7 and a first representation of information of a second type stored in the multimedia document; 

8 displaying, in the first area of the GUI, a first lens positionable over a plurality of 

9 portions of the first visual representation displayed within the first area of the GUI, the first lens 

10 covering a first portion of the first visual representation within the first area; [[and]] 

1 1 displaying, in a second area of the GUI, a second visual representation of the 



12 multimedia information stored in the multimedia document based on the first lens covering the 

13 first portion of the first visual representation within the first area, the second visual 

14 representation including a second representation of the information of the first type stored in the 

15 multimedia document and a second representation of the information of the second type stored in 

16 the multimedia document; 



17 displaying, in the second area of the GUI, a second lens positionable over a 

18 plurality of portions of the second visual representation displayed within the second area of the 

19 GUI, the second lens covering a first portion of the second visual representation within the 

20 second area; and 

21 displaying, in a third area of the GUI, a third visual representation of the 

22 multimedia information stored in the multimedia document based on the second lens covering 

23 the first portion of the second visual representation within the second area , the third visual 
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24 representation including a third representation of the information of the first type and a third 

25 representation of the information of the second type. 



26 wherein displaying the first visual representation of the multimedia information 

27 stored in the multimedia document in the first area of the GUI comprises: 

28 displaying a first thumbnail image in the first area of the GUI, the first 

29 thumbnail image comprising the first representation of the information of the first type; 

30 and 

31 displaying a second thumbnail image in the first area of the GUI, the 

32 second thumbnail image comprising the first representation of the information of the 

33 second type, 

34 wherein displaying the second visual representation of the multimedia 

35 information stored in the multimedia document in the second area of the GUI comprises: 

36 displaying, in a first sub-area of the second area of the GUI, the portion of 

37 the first representation of the information of the first type covered by the first lens as the 

38 second representation of the information of the first type; and 

39 displaying, in a second sub-area of the second area of the GUI, the portion 

40 of the first representation of the information of the second type covered by the first lens 

41 as the second representation of the information of the second type, 

42 wherein displaying the third visual representation of the multimedia information 

43 stored in the multimedia document in the third area of the GUI comprises: 

44 displaying, in a first sub-area of the third area of the GUI, the portion of 

45 the second representation of the information of the first type covered by the second lens 

46 as the third representation of the information of the first type; and 

47 displaying, in a second sub-area of the third area of the GUI, the portion of 

48 the second representation of the information of the second type covered by the second 

49 lens as the third representation of the information of the first type . 
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1 2. (Previously presented) The method of claim 1 wherein displaying the first 

2 visual representation of the multimedia information stored in the multimedia document 

3 comprises: 

4 displaying a first thumbnail image in the first area of the GUI, the first thumbnail 

5 image comprising the first representation of the information of the first type; and 

6 displaying a second thumbnail image in the first area of the GUI, the second 

7 thumbnail image comprising the first representation of the information of the second type. 

1 3. (Previously presented) The method of claim 1 wherein displaying the 

2 second visual representation of the multimedia information stored in the multimedia document 

3 comprises: 

4 displaying, in a first sub-area of the second area of the GUI, the second 

5 representation of the information of the first type as a portion of the first representation of the 

6 information of the first type covered by the first lens ; and 

7 displaying, in a second sub-area of the second area of the GUI, the second 

8 representation of the information of the first type as a portion of the first representation of the 

9 information of the second type covered by the first lens . 

1 4. (Previously presented) The method of claim 1 wherein displaying the 

2 second visual representation of the multimedia information stored in the multimedia document 

3 comprises: 

4 determining a first time and a second time associated with the first lens; 

5 displaying, in the second area of the GUI, a representation of the information of 

6 the first type occurring between the first time and the second time associated with the first lens as 

7 the second representation of the information of the first type; and 

8 displaying, in the second area of the GUI, a representation of the information of 

9 the second type occurring between the first time and the second time associated with the first 
1 0 lens as the second representation of the information of the second type. 
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1 5. (Previously presented) The method of claim 1 further comprising: 

2 receiving user input moving the first lens over the first visual representation 

3 displayed within the first area to cover a second portion of the first visual representation within 

4 the first area; and 

5 responsive to the user input, automatically changing the second visual 



6 representation displayed in the second area of the GUI such that the second visual representation 

7 of the multimedia information stored in the multimedia document displayed in the second area of 

8 the GUI corresponds to the second portion of the first visual representation of the multimedia 

9 information stored in the multimedia document covered by the first lens. 

6. (Canceled) 



1 7. (Currently amended) The method of claim [[6]}! wherein displaying, in 

2 the third area of the GUI, the third visual representation of the multimedia information stored in 

3 the multimedia document comprises: 

4 determining a first time and a second time associated with the second lens; 

5 displaying, in the third area of the GUI, a representation of the information of the 

6 first type occurring between the first time and the second time associated with the second lens as 

7 the third representation of the information of the first type; and 

8 displaying, in the third area of the GUI, a representation of the information of the 

9 second type occurring between the first time and the second time associated with the second lens 
1 0 as the third representation of the information of the second type. 

8. (Canceled) 
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1 9. (Currently amended) The method of claim £[6]]i further comprising: 

2 receiving user input moving the second lens over the second visual representation 

3 displayed within the second area to cover a second portion of the second visual representation 

4 within the second area; and 

5 responsive to the user input, automatically changing the third visual 

6 representation displayed in the third area of the GUI such that the third visual representation of 

7 the multimedia information stored in the multimedia document displayed in the third area of the 

8 GUI corresponds to the second portion of the second visual representation of the multimedia 

9 information stored in the multimedia document covered by the second lens. 

1 10. (Currently amended) The method of claim [[6]]i further comprising: 

2 receiving user input moving the first lens over the first visual representation 

3 displayed within the first area to cover a second portion of the first visual representation within 

4 first area; and 

5 responsive to the user input, automatically: 

6 changing the second visual representation displayed in the second area of 

7 the GUI such that the second visual representation of the multimedia information stored in the 

8 multimedia document displayed in the second area of the GUI corresponds to the second portion 

9 of the first visual representation of the multimedia information stored in the multimedia 

10 document covered by the first lens; and 

1 1 changing the third visual representation displayed in the third area of the 

12 GUI such that the third visual representation of the multimedia information stored in the 

13 multimedia document displayed in the third area of the GUI corresponds to the second visual 

14 representation of the multimedia information stored by the multimedia document within the 

15 second area. 
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1 11. (Currently amended) The method of claim £[6]]i further comprising: 

2 displaying a sub-lens covering a portion of the first visual representation 

3 displayed within the first area of the GUI corresponding to the first portion of the second visual 

4 representation within the second area of the GUI covered by the second lens. 

1 12. (Previously presented) The method of claim 1 1 further comprising: 

2 receiving user input moving the second lens over the second visual representation 

3 displayed within the second area to cover a second portion of the second visual representation 

4 within the second area; and 

5 responsive to the user input, automatically changing position of the sub-lens to 

6 cover a portion of the first visual representation displayed within the first area of the GUI 

7 corresponding to the second portion of the second visual representation within the second area 

8 covered by the second lens. 

1 13. (Previously presented) The method of claim 1 wherein: 

2 the information of the first type corresponds to video information; and 

3 the first representation of the information of the first type comprises one or more 

4 video keyframes extracted from the video information. 

1 14. (Previously presented) The method of claim 13 wherein: 

2 the information of the second type corresponds to audio information; and 

3 the first representation of the information of the second type comprises text 

4 information obtained from transcribing the audio information. 

1 15. (Previously presented) The method of claim 13 wherein: 

2 the information of the second type corresponds to closed-caption (CC) text 

3 information; and 

4 the first representation of the information of the second type comprises text 

5 information included in the CC text information. 
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1 16. (Previously presented) The method of claim 1 further comprising: A 

2 method of displaying multimedia information stored in a multimedia document on a display, the 

3 method comprising: 

4 displaying a graphical user interface (GUI) on the display; 

5 displaying, in a first area of the GUI, a first visual representation of the 

6 multimedia information stored in the multimedia document, the first visual representation 

7 including a first representation of information of a first type stored in the multimedia document 

8 and a first representation of information of a second type stored in the multimedia document; 

9 displaying, in the first area of the GUI, a first lens positionable over a plurality of 

10 portions of the first visual representation displayed within the first area of the GUI, the first lens 

1 1 covering a first portion of the first visual representation within the first area; 

12 displaying, in a second area of the GUI, a second visual representation of the 



13 multimedia information stored in the multimedia document based on the first lens covering the 

14 first portion of the first visual representation within the first area, the second visual 

15 representation including a second representation of the information of the first type stored in the 

16 multimedia document and a second representation of the information of the second type stored in 

17 the multimedia document; 



1 8 receiving information indicating a user-specified concept of interest; and 

1 9 analyzing the multimedia information stored in the multimedia document to 

20 identify one or more locations in the multimedia information that are relevant to the user- 

2 1 specified concept of interest; 

22 wherein displaying, in the first area of the GUI, the first visual representation of 

23 the multimedia information stored in the multimedia document comprises annotating the one or 

24 more locations in the multimedia information that are relevant to the user-specified concept of 

25 interest; and 

26 wherein displaying, in the second area of the GUI, the second visual 

27 representation of the multimedia information stored in the multimedia document comprises 

28 annotating the one or more locations in the multimedia information that are relevant to the user- 
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29 specified concept of interest and that are located in the first portion of the first visual 

30 representation covered by the first lens within the first area. 



1 17. (Original) The method of claim 1 further comprising: 

2 receiving input indicating selection of a portion of the multimedia information 

3 occurring between a first time and a second time; and 

4 performing a first operation on the portion of the multimedia information 

5 occurring between a first time and a second time. 

18-39. (Canceled) 

1 40. (Currently amended) A computer program product stored on a computer- 

2 readable storage medium for displaying multimedia information stored in a multimedia 

3 document on a display, the computer program product comprising: 

4 code for displaying a graphical user interface (GUI) on the display; 

5 code for displaying, in a first area of the GUI, a first visual representation of the 

6 multimedia information stored in the multimedia document, the first visual representation 

7 including a first representation of information of a first type stored in the multimedia document 

8 and a first representation of information of a second type stored in the multimedia document; 

9 code for displaying a first lens positionable over a plurality of portions of the first 

10 visual representation displayed within the first area of the GUI, the first lens covering a first 

1 1 portion of the first visual representation within the first area; [[and]] 

12 code for displaying, in a second area of the GUI, a second visual representation of 

13 the multimedia information stored in the multimedia document based on the first lens covering 

14 the first portion of the first visual representation within the first area, the second visual 

15 representation including a second representation of the information of the first type stored in the 

16 multimedia document and a second representation of the information of the second type stored in 

17 the multimedia document; 
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18 code for displaying, in the second area of the GUI, a second lens positionable over 

19 a plurality of portions of the second visual representation displayed within the second area of the 

20 GUI, the second lens covering a first portion of the second visual representation within the 

21 second area; and 

22 code for displaying, in a third area of the GUI, a third visual representation of the 

23 multimedia information stored in the multimedia document based on the second lens covering 

24 the first portion of the second visual representation within the second area, the third visual 

25 representation comprising a third representation of the information of the first type and a third 

26 representation of the information of the second type, 

27 wherein the code for displaying the first visual representation of the multimedia 

28 information stored in the multimedia document in the first area of the GUI comprises: 

29 code for displaying a first thumbnail image in the first area of the GUI, the 

30 first thumbnail image comprising the first representation of the information of the first 

31 type; and 

32 code for displaying a second thumbnail image in the first area of the GUI, 

33 the second thumbnail image comprising the first representation of the information of the 

34 second type, 

35 wherein the code for displaying the second visual representation of the 

36 multimedia information stored in the multimedia document in the second area of the GUI 

37 comprises: 

38 code for displaying, in a first sub-area of the second area of the GUI, the 

39 portion of the first representation of the information of the first type covered by the first 

40 lens; and 

41 code for displaying, in a second sub-area of the second area of the GUI, 

42 the portion of the first representation of the information of the second type covered by the 

43 first lens, 

44 wherein the code for displaying the third visual representation of the multimedia 

45 information stored in the multimedia document in the third area of the GUI comprises: 
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46 code for displaying, in a first sub-area of the third area of the GUI, the 

47 portion of the second representation of the information of the first type covered by the 

48 second lens as the third representation of the information of the first type; and 

49 code for displaying, in a second sub-area of the third area of the GUI, the 

50 portion of the second representation of the information of the second type covered by the 

51 second lens as the third representation of the information of the second type . 

1 41. (Previously presented) The computer program product of claim 40 

2 wherein the code for displaying the first visual representation of the multimedia information 

3 stored in the multimedia document comprises: 

4 code for displaying a first thumbnail image in the first area of the GUI, the first 

5 thumbnail image comprising the first representation of the information of the first type; and 

6 code for displaying a second thumbnail image in the first area of the GUI, the 

7 second thumbnail image comprising the first representation of the information of the second 

8 type. 

1 42. (Currently amended) The computer program product of claim 40 wherein 

2 the code for displaying the second visual representation of the multimedia information stored in 

3 the multimedia document comprises: 

4 code for displaying, in a first sub-area of the second area of the GUI, the second 

5 representation of the information of the first type as a portion of the first representation of the 

6 information of the first type covered by the first lens; and 

7 code for displaying, in a second sub-area of the second area of the GUI, the 

8 second representation of the information of the second type as a portion of the first 

9 representation of the information of the second type covered by the first lens. 

1 43. (Previously presented) The computer program product of claim 40 

2 wherein the code for displaying the second visual representation of the multimedia information 

3 stored in the multimedia document comprises: 
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4 code for determining a first time and a second time associated with the first lens; 

5 code for displaying, in the second area of the GUI, a representation of information 

6 of the first type occurring between the first time and the second time associated with the first lens 

7 as the second representation of the information of the first type; and 

8 code for displaying, in the second area of the GUI, a representation of information 

9 of the second type occurring between the first time and the second time associated with the first 
10 lens as the second representation of the information of the second type. 

1 44. (Previously presented) The computer program product of claim 40 further 

2 comprising: 

3 code for receiving user input moving the first lens over the first visual 

4 representation within the first area to cover a second portion of the first visual representation 

5 within the first area; and 

6 code for responsive to the user input, automatically changing the second visual 



7 representation displayed in the second area of the GUI such that the second visual representation 

8 of the multimedia information stored in the multimedia document displayed in the second area of 

9 the GUI corresponds to the second portion of the first visual representation of the multimedia 
10 information stored in the multimedia document covered by the first lens. 

45. (Canceled) 



1 46. (Currently amended) The computer program product of claim [[45JJ40 

2 wherein the code for displaying, in the third area of the GUI, the third visual representation of 

3 the multimedia information stored in the multimedia document comprises: 

4 code for determining a first time and a second time associated with the second 

5 lens; 

6 code for displaying, in the third area of the GUI, a representation of the 

7 information of the first type occurring between the first time and the second time associated with 

8 the second lens as the third representation of the information of the first type; and 
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9 code for displaying, in the third area of the GUI, a representation of the 

10 information of the second type occurring between the first time and the second time associated 

1 1 with the second lens as the third representation of the information of the second type. 

47. (Canceled) 

1 48. (Currently amended) The computer program product of claim £[45]J40 

2 further comprising: 

3 code for receiving user input moving the second lens over the second visual 

4 representation displayed within the second area to cover a second portion of the second visual 

5 representation within the second area; and 

6 responsive to the user input, code for automatically changing the third visual 

7 representation displayed in the third area of the GUI such that the third visual representation of 

8 the multimedia information stored in the multimedia document displayed in the third area of the 

9 GUI corresponds to the second portion of the second visual representation of the multimedia 
10 information stored in the multimedia document covered by the second lens. 

1 49. (Currently amended) The computer program product of claim [[45JJ40 

2 further comprising: 

3 code for receiving user input moving the first lens [[erjjoyer the first visual 

4 representation displayed within the first area to cover a second portion of the first visual 

5 representation within the first area; and 

6 responsive to the user input, code for automatically: 

7 changing the second visual representation displayed in the second area of 

8 the GUI such that the second visual representation of the multimedia information stored 

9 in the multimedia document displayed in the second area of the GUI corresponds to the 

10 second portion of the first visual representation of the multimedia information stored in 

1 1 the multimedia document covered by the first lens; and 
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12 changing the third visual representation displayed in the third area of the 

13 GUI such that the third visual representation of the multimedia information stored in the 

14 multimedia document displayed in the third area of the GUI corresponds to the second 

15 visual representation of the multimedia information stored by the multimedia document 

16 within the second area. 

1 50. (Currently amended) The computer program product of claim [[45JJ40 

2 further comprising: 

3 code for displaying a sub-lens covering a portion of the first visual representation 

4 displayed within the first area of the GUI corresponding to the first portion of the second visual 

5 representation within the second area of the GUI covered by the second lens. 

1 51. (Previously presented) The computer program product of claim 50 further 

2 comprising: 

3 code for receiving user input moving the second lens over the second visual 

4 representation displayed within the second area to cover a second portion of the second visual 

5 representation within the second area; and 

6 responsive to the user input, code for automatically changing position of the sub- 

7 lens to cover a portion of the first visual representation displayed within the first area of the GUI 

8 corresponding to the second visual representation within the second area covered by the second 

9 lens. 

1 52. (Previously presented) The computer program product of claim 40 

2 wherein: 

3 the information of the first type corresponds to video information; and 

4 the first representation of the information of the first type comprises one or more 

5 video keyframes extracted from the video information. 
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1 53. (Previously presented) The computer program product of claim 52 

2 wherein: 

3 the information of the second type corresponds to audio information; and 

4 the first representation of information of the second type comprises text 

5 information obtained from transcribing the audio information. 

1 54. (Previously presented) The computer program product of claim 52 

2 wherein: 

3 the information of the second type corresponds to closed-caption (CC) text 

4 information; and 

5 the first representation of information of the second type comprises text 

6 information included in the CC text information. 

1 55. (Currently amended) The computer program product of claim ^10 furth e r 

2 comprising: A computer program product stored on a computer-readable storage medium for 

3 displaying multimedia information stored in a multimedia document on a display, the computer 

4 program product comprising: 

5 code for displaying a graphical user interface (GUI) on the display; 

6 code for displaying, in a first area of the GUI, a first visual representation of the 

7 multimedia information stored in the multimedia document, the first visual representation 

8 including a first representation of information of a first type stored in the multimedia document 

9 and a first representation of information of a second type stored in the multimedia document; 

10 code for displaying a first lens positionable over a plurality of portions of the first 

11 visual representation displayed within the first area of the GUI, the first lens covering a first 

12 portion of the first visual representation within the first area; 

13 code for displaying, in a second area of the GUI, a second visual representation of 

14 the multimedia information stored in the multimedia document based on the first lens covering 

15 the first portion of the first visual representation within the first area, the second visual 
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16 representation including a second representation of the information of the first type stored in the 

17 multimedia document and a second representation of the information of the second type stored in 

18 the multimedia document; 



19 code for receiving information indicating a user-specified concept of interest; and 

20 code for analyzing the multimedia information stored in the multimedia document 

21 to identify one or more locations in the multimedia information that are relevant to the user- 

22 specified concept of interest; 

23 wherein the code for displaying, in the first area of the GUI, the first visual 

24 representation of the multimedia information stored in the multimedia document comprises code 

25 for annotating the one or more locations in the multimedia information that are relevant to the 

26 user-specified concept of interest; and 

27 wherein the code for displaying, in the second area of the GUI, the second visual 

28 representation of the multimedia information stored in the multimedia document comprises code 

29 for annotating the one or more locations in the multimedia information that are relevant to the 

30 user-specified concept of interest and that are located in the first portion of the first visual 

3 1 representation covered by the first lens within the first area. 

1 56. (Original) The computer program product of claim 40 further comprising: 

2 code for receiving input indicating selection of a portion of the multimedia 

3 information occurring between a first time and a second time; and 

4 code for performing a first operation on the portion of the multimedia information 

5 occurring between a first time and a second time. 

57-75. (Canceled) 
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1 76. (Currently amended) A system for displaying multimedia information 

2 stored in a multimedia document, the system comprising: 

3 a display; 

4 a processor; and 

5 a memory coupled to the processor, the memory configured to store a plurality of 

6 code modules for execution by the processor, the plurality of code modules comprising: 

7 a code module for displaying a graphical user interface (GUI) on the 

8 display; 

9 a code module for displaying, in a first area of the GUI, a first visual 

10 representation of the multimedia information stored in the multimedia document, the first 

1 1 visual representation including a first representation of information of a first type stored 

12 in the multimedia document and a first representation of information of a second type 

13 stored in the multimedia document; 

14 a code module for displaying, in the first area of the GUI, a first lens 

15 positionable over a plurality of portions of the first visual representation displayed within 

16 the first area of the GUI, the first lens covering a first portion of the first visual 

17 representation within the first area; Hand]] 

1 8 a code module for displaying, in a second area of the GUI, a second visual 

19 representation of the multimedia information stored in the multimedia document based on 

20 the first lens covering the first portion of the first visual representation within the first 

21 area, the second visual representation including a second representation of the 

22 information of the first type stored in the multimedia document and a second 

23 representation of the information of the second type stored in the multimedia document; 

24 a code module for displaying, in the second area of the GUI, a second lens 

25 positionable over a plurality of portions of the second visual representation displayed 

26 within the second area of the GUI, the second lens covering a first portion of the second 

27 visual representation within the second area; and 
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28 a code module for displaying, in a third area of the GUI, a third visual 

29 representation of the multimedia information stored in the multimedia document based on 

30 the second lens covering the first portion of the second visual representation within the 

31 second area, the third visual representation including a third representation of the 

32 information of the first type and a third representation of the information of the second 

33 type, 

34 wherein the code module for displaying the first visual representation of the 

35 multimedia information stored in the multimedia document in the first area of the GUI 

36 comprises: 

37 a code module for displaying a first thumbnail image in the first area of 

38 the GUI, the first thumbnail image comprising the first representation of the information 

39 of the first type; and 

40 a code module for displaying a second thumbnail image in the first area of 

41 the GUI, the second thumbnail image comprising the first representation of the 

42 information of the second type, 

43 wherein the code module for displaying the second visual representation of the 

44 multimedia information stored in the multimedia document in the second area of the GUI 

45 comprises: 

46 a code module for displaying, in a first sub-area of the second area of the 

47 GUI, the portion of the first representation of the information of the first type covered by 

48 the first lens as the second representation of the information of the first type; and 

49 a code module for displaying, in a second sub-area of the second area of 

50 the GUI, the portion of the first representation of the information of the second type 

51 covered by the first lens as the second representation of the information of the second 

52 type, 

53 wherein the code module for displaying the third visual representation of the 

54 multimedia information stored in the multimedia document in the third area of the GUI 

55 comprises: 
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56 a code module for displaying, in a first sub-area of the third area of the 

57 GUI, the portion of the second representation of the information of the first type covered 

58 by the second lens as the third representation of the information of the first type; and 

59 a code module for displaying, in a second sub-area of the third area of the 

60 GUI, the portion of the second representation of the information of the second type 

61 covered by the second lens as the third representation of the information of the first type . 

1 77. (Previously presented) The system of claim 76 wherein the code module 

2 for displaying the first visual representation of the multimedia information stored in the 

3 multimedia document comprises: 

4 a code module for displaying a first thumbnail image in the first area of the GUI, 

5 the first thumbnail image comprising the first representation of the information of the first type; 

6 and 

7 a code module for displaying a second thumbnail image in the first area of the 

8 GUI, the second thumbnail image comprising the first representation of the information of the 

9 second type. 

1 78. (Currently amended) The system of claim 76 wherein the code module for 

2 displaying the second visual representation of the multimedia information stored in the 

3 multimedia document comprises: 

4 a code module for, in a first sub-area of the second area of the GUI, the second 

5 representation of the information of the first type as a portion of the first representation of the 

6 information of the first type covered by the first lens; and 

7 a code module for displaying, in a second sub-area of the second area of the GUI, 

8 the second representation of the information of the first type as a portion of the first 

9 representation of the information of the second type covered by the first lens. 



Page 19 of 27 



Appl. No. 10/081,129 PATENT 
Amdt. dated March 28, 2009 

Amendment under 37 CFR 1.116 Expedited Procedure 
Examining Group 2179 



1 79. (Previously presented) The system of claim 76 wherein the code module 

2 for displaying the second visual representation of the multimedia information stored in the 

3 multimedia document comprises: 

4 a code module for determining a first time and a second time associated with the 

5 first lens; 

6 a code module for displaying, in the second area of the GUI, a representation of 

7 the information of the first type occurring between the first time and the second time associated 

8 with the first lens as the second representation of the information of the first type; and 

9 a code module for displaying, in the second area of the GUI, a representation of 

10 the information of the second type occurring between the first time and the second time 

1 1 associated with the first lens as the second representation of the information of the second type. 

1 80. (Previously presented) The system of claim 76 wherein the plurality of 

2 code modules further comprises: 

3 a code module for receiving user input moving the first lens over the first visual 

4 representation displayed within the first area to cover a second portion of the first visual 

5 representation within the first area; and 

6 responsive to the user input, a code module for automatically changing the second 



7 visual representation displayed in the second area of the GUI such that the second visual 

8 representation of the multimedia information stored in the multimedia document displayed in the 

9 second area of the GUI corresponds to the second portion of the first visual representation of the 
1 0 multimedia information stored in the multimedia document covered by the first lens. 

81. (Canceled) 

1 82. (Currently amended) The system of claim [[8 1]]76 wherein the code 

2 module for displaying, in the third area of the GUI, the third visual representation of the 

3 multimedia information stored in the multimedia document comprises: 
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4 a code module for determining a first time and a second time associated with the 

5 second lens; 

6 a code module for displaying, in the third area of the GUI, a representation of the 

7 information of the first type occurring between the first time and the second time associated with 

8 the second lens as the third representation of the information of the first type; and 

9 a code module for displaying, in the third area of the GUI, a representation of the 

10 information of the second type occurring between the first time and the second time associated 

1 1 with the second lens as the third representation of the information of the second type. 

83. (Canceled) 

1 84. (Currently amended) The system of claim [[811176 wherein the plurality 

2 of code modules further comprises: 

3 a code module for receiving user input moving the second lens over the second 

4 visual representation displayed within the second area to cover a second portion of the second 

5 visual representation within the second area; and 

6 responsive to the user input, a code module for automatically changing the third 

7 visual representation displayed in the third area of the GUI such that the third visual 

8 representation of the multimedia information stored in the multimedia document displayed in the 

9 third area of the GUI corresponds to the second portion of the second visual representation of the 
10 multimedia information stored in the multimedia document covered by the second lens. 

1 85. (Currently amended) The system of claim [[8 1JJ76 wherein the plurality 

2 of code modules further comprises: 

3 a code module for receiving user input moving the first lens over the first visual 

4 representation displayed within the first area to cover a second portion of the first visual 

5 representation within first area; and 

6 responsive to the user input, a code module for automatically: 
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7 changing the second visual representation displayed in the second area of 

8 the GUI such that the second visual representation of the multimedia information stored in the 

9 multimedia document displayed in the second area of the GUI corresponds to the second portion 

10 of the first visual representation of the multimedia information stored in the multimedia 

1 1 document covered by the first lens; and 

12 changing the third visual representation displayed in the third area of the 

13 GUI such that the third visual representation of the multimedia information stored in the 

14 multimedia document displayed in the third area of the GUI corresponds to the second visual 

15 representation of the multimedia information stored by the multimedia document within the 

16 second area. 

1 86. (Currently amended) The system of claim [[8 1 JJ76 wherein the plurality 

2 of code modules further comprises: 

3 a code module for displaying a sub-lens covering a portion of the first visual 

4 representation displayed within the first area of the GUI corresponding to the first portion of the 

5 second visual representation within the second area of the GUI covered by the second lens. 

1 87. (Previously presented) The system of claim 86 wherein the plurality of 

2 code modules further comprises: 

3 a code module for receiving user input moving the second lens over the second 

4 visual representation displayed within the second area to cover a second portion of the second 

5 visual representation within the second area; and 

6 responsive to the user input, a code module for automatically changing position of 

7 the sub-lens to cover a portion of the first visual representation displayed within the first area of 

8 the GUI corresponding to the second portion of the second visual representation within the 

9 second area covered by the second lens. 
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1 88. (Previously presented) The system of claim 76 wherein: 

2 the information of the first type corresponds to video information; and 

3 the first representation of the information of the first type comprises one or more 

4 video keyframes extracted from the video information. 

1 89. (Previously presented) The system of claim 88 wherein: 

2 the information of the second type corresponds to audio information; and 

3 the first representation of the information of the second type comprises text 

4 information obtained from transcribing the audio information. 

1 90. (Previously presented) The system of claim 88 wherein: 

2 the information of the second type corresponds to closed-caption (CC) text 

3 information; and 

4 the first representation of the information of the second type comprises text 

5 information included in the CC text information. 

1 91. (Currently amended) The system of claim 76 whoroin the plurality of 

2 code modules further comprises: A system for displaying multimedia information stored in a 

3 multimedia document, the system comprising: 

4 a display; 

5 a processor; and 

6 a memory coupled to the processor, the memory configured to store a plurality of 

7 code modules for execution by the processor, the plurality of code modules comprising: 

8 a code module for displaying a graphical user interface (GUI) on the 

9 display; 

10 a code module for displaying, in a first area of the GUI, a first visual 

11 representation of the multimedia information stored in the multimedia document, the first 

12 visual representation including a first representation of information of a first type stored 
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13 in the multimedia document and a first representation of information of a second type 

14 stored in the multimedia document; 

15 a code module for displaying, in the first area of the GUI, a first lens 

16 positionable over a plurality of portions of the first visual representation displayed within 

17 the first area of the GUI, the first lens covering a first portion of the first visual 

18 representation within the first area; 

19 a code module for displaying, in a second area of the GUI, a second visual 

20 representation of the multimedia information stored in the multimedia document based on 

21 the first lens covering the first portion of the first visual representation within the first 

22 area, the second visual representation including a second representation of the 

23 information of the first type stored in the multimedia document and a second 

24 representation of the information of the second type stored in the multimedia document; 

25 a code module for receiving information indicating a user-specified 

26 concept of interest; and 

27 a code module for analyzing the multimedia information stored in the 

28 multimedia document to identify one or more locations in the multimedia information 

29 that are relevant to the user-specified concept of interest; 

30 wherein the code module for displaying, in the first area of the GUI, the first 

3 1 visual representation of the multimedia information stored in the multimedia document 

32 comprises annotating the one or more locations in the multimedia information that are relevant to 

33 the user- specified concept of interest; and 

34 wherein the code module for displaying, in the second area of the GUI, the second 

35 visual representation of the multimedia information stored in the multimedia document 

36 comprises annotating the one or more locations in the multimedia information that are relevant to 

37 the user- specified concept of interest and that are located in the first portion of the first visual 

38 representation covered by the first lens within the first area. 
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1 92. (Original) The system of claim 76 wherein the plurality of code modules 

2 further comprises: 

3 a code module for receiving input indicating selection of a portion of the 

4 multimedia information occurring between a first time and a second time; and 

5 a code module for performing a first operation on the portion of the multimedia 

6 information occurring between a first time and a second time. 

93-111. (Canceled) 
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